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CIRCUITRY AND SYSTEMS FOR PERFORMING TWO-DIMENSIONAL MOTION 
COMPENSATION USING A THREE-DIMENSIONAL PIPELINE 
AND METHODS OF OPERATING THE SAME 

TECHNICAL FIELD OF THE INVENTION 

The present invention is directed, in general, to image 
processing systems and, more specifically, to circuitry and systems 
for performing two-dimensional motion compensation using a three- 
dimensional pipeline and methods of operating the same. 

BACKGROUND OF THE INVENTION 

The ever- increasing demand for faster image processing systems 
dictates that state-of-the-art image processors execute 
instructions and process data in the minimum amount of time. Over 
the years, image processor speeds have been increased in a variety 
of ways, including, increasing the speed of the clock that drives 
the processor, reducing the number of clock cycles required to 
perform a given instruction, reducing the number of gate delays 
incurred while executing an instruction, increasing the number of 
instruction pipelines, and the like. 
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An instruction pipeline is a series of separate instruction 
processing stages. Each stage is independent and is optimized to 
perform a specific portion of the overall instruction processing. 
Thus, instructions may be fed into the first stage of the pipeline 
and each stage performs a specific portion of the instruction, much 
like an assembly line. It is typically not necessary for one 
instruction to finish processing before the next instruction is 
loaded into the pipeline. Multiple instructions may therefore be 
loaded into the instruction pipeline (e.g., a five stage 
instruction pipeline may contain up to five instructions at one 
time) . 

The instruction pipeline concept has been extended to multiple 
pipeline architectures. In a multiple pipeline architecture, an 
instruction decoder feeds instructions to two or more instruction 
pipelines. The instruction decoder may select a particular 
pipeline based on which instructions are already in each pipeline, 
how fast the instructions are expected to flow through the 
remaining pipeline stages, the "speciality" of the particular 
pipeline, or the like. 

Multiple pipeline architectures are well suited for processing 
two-dimensional and three-dimensional image data ("graphics 
processing"). Graphics processing techniques commonly describe 
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images in terms of the dimensions of the objects to be represented. 
For instance, an image processing system may represent objects in 
two-dimensional space {e.g., having x and y coordinates, wherein 
the graphics are said to be "two-dimensional"), and 
three-dimensional (e.g., having x, y, and z coordinates, wherein 
the graphics are said to be "three-dimensional") . 

Graphics processing systems commonly display two-dimensional 
and three-dimensional graphics representations of objects on a two- 
dimensional image display screen (e.g., computer monitor, 
television, etc.). These systems "break down" the graphical 
representation of an object into graphics primitives (e.g., points, 
lines, quadrilaterals, triangle strips, polygons, etc.) and process 
the same in one of two image-processing pipelines. If the object 
is represented in two-dimensional image space, then it is processed 
in a two-dimensional image pipeline to generate successive 
two-dimensional image frames. If the object is represented in 
three-dimensional image space, then it is processed in a 
three-dimensional image pipeline to render successive three- 
dimensional image frames. 

For instance, the primitives of a three-dimensional object to 
be rendered are defined in terms of primitive data, so that when 
the primitive is a triangle, its primitive data may be defined in 
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terms of the X, Y, Z and W coordinates of its vertices, as well as 
the red, green and blue and alpha color values of each vertex (of 
course, additional primitive data may be used in specific 
applications) . The three-dimensional pipeline interpolates the 
primitive data to compute the coordinates and colors of display- 
screen pixels that represent each primitive, and the R, G and B 
color values for each pixel . 

The availability of graphics processing is becoming 
increasingly important, and not only in entertainment related 
applications {e.g., video games, DVD systems, direct broadcast 
satellites, production quality film animation tools, etc.)/ but in 
many other broader areas, such as education, video conferencing, 
video editing, interactive user interfaces, computer-aided design 
and computer-aided manufacturing ("CAD/CAM"), scientific and 
medical imaging, business applications, and electronic publishing, 
among others . 

Conventional image processors are commonly built with separate 
functional units for handling two-dimensional (e.g., decoder, 
quantization controller, motion compensation controller, etc.) and 
three dimensional image processing operations (e.g., a geometry 
accelerator, a rasterizer, etc.). A primary disadvantage to such 
implementations is the relative size of the processing logic 
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associated with the functional units necessary to provide the 
above-described multiple pipelined architecture. 

Further, there are symmetries among various processes 
performed by certain ones of the functional units associated with 
each of the two image processing pipelines, however, contemporary 
implementations fail to utilize the same to implement mult i -modal 
units that meet the functional requirements of both two- and three- 
dimensional image processing pipelines. 

Therefore, while an ongoing need exists in the art for 
improved image processors that include multiple instruction 
pipelines, a particular need has arisen in the art for a multiple 
instruction pipeline image processor that efficiently utilizes such 
inherent symmetries in implementing two- and three-dimensional 
image processing pipelines, thereby reducing the overall number 
functional units, and chip area or board space required to support 
the same . 
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SUMMARY OF THE INVENTION 

The limitations inherent in the above-described prior art are 
overcome by the present invention which provides broadly circuitry 
and systems for performing two-dimensional motion compensation 
using a three-dimensional image processing pipeline, as well as 
methods of operating the same. The present invention 

advantageously employs the inherent symmetries of the functional 
units performing motion compensation operations in the two- 
dimensional pipeline on the one hand and rasterization operations 
in the three-dimensional pipeline on the other hand. 

According to a primary advantageous embodiment, dual mode sub- 
processing circuitry is introduced for use in the image processing 
circuitry having both two- and three-dimensional image processing 
pipelines. The dual mode sub-processing circuitry is associated 
with the two- and three-dimensional image pipelines and is operable 
to perform (i) motion compensation operations associated with the 
two-dimensional image pipeline in one mode, and (ii) rasterization 
operations associated the three-dimensional image pipeline in 
another mode . 

In a related advantageous embodiment, the two-dimensional 
pipeline is MPEG standards compliant. The motion compensation 
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operations of the exemplary MPEG decompression process applies 
motion vector data to one or more image frames to generate a 
successive, or "new," image frame. The dual mode sub-processing 
circuitry is therefore operable to sample reference frames while 
5 performing the motion compensation operations of the MPEG 
decompression process in the one mode, while being operable to 
perform texture mapping associated with standard three-dimensional 
rasterization in the other mode. The process of sampling reference 

3f frames with bi- linear filtering in two-dimensional motion 

«= 

lO^r compensation is similar to performing texture mapping with bilinear 
filtering in three-dimensional rasterization. 

In a further related embodiment, the dual mode sub-processing 

£ 

!^ circuitry is operable to blend samples from a plurality of 
=j reference frames while performing the motion compensation 

15;;J operations of the MPEG decompression process in the one mode, while 
being operable to blend samples from a plurality of texture maps 
associated with standard three-dimensional rasterization in the 
other mode. The process of blending, or combining, the samples 
from multiple reference frames is similar to combining multiple 

20 texture maps during rasterization, the primary difference being 
that the blend factor is static during motion compensation 
operations, preferably fixed at one half (3^) . 
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In yet another related embodiment, the dual mode sub- 
processing circuitry is operable to process the sampled reference 
frames using error terms while performing the motion compensation 
operations of the MPEG decompression process in the one mode, while 
being operable to perform alpha blending associated with standard 
three-dimensional rasterization in the other mode. The process of 
adding error terms to the reference frame samples is similar to the 
alpha blending sub-process in the three-dimensional rasterization 
pipeline . 

The foregoing has outlined rather broadly the features and 
technical advantages of the present invention so that those skilled 
in the art may better understand the detailed description of the 
invention that follows. Additional features and advantages of the 
invention will be described hereinafter that form the subject of 
the claims of the invention. Those skilled in the art should 
appreciate that they may readily use the conception and the 
specific embodiment disclosed as a basis for modifying or designing 
other structures for carrying out the same purposes of the present 
invention. Those skilled in the art should also realize that such 
equivalent constructions do not depart from the spirit and scope of 
the invention in its broadest form. 
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Before undertaking the DETAILED DESCRIPTION OF THE INVENTION, 
it may be advantageous to set forth definitions of certain words 
and phrases used throughout this patent document: the terms 
"include" and "comprise," as well as derivatives thereof, mean 
5 inclusion without limitation; the term "or," is inclusive, meaning 
and/or; the phrases "associated with" and "associated therewith," 
as well as derivatives thereof, may mean to include, be included 
within, interconnect with, contain, be contained within, connect to 
Kl or with, couple to or with, be communicable with, cooperate with, 

in 

10 interleave, juxtapose, be proximate to, be bound to or with, have, 

1^=^ have a property of, or the like; and the terms "controller," 

y "processor" and "circuitry" mean any device, system or part thereof 

C3 that controls at least one operation, such a device, system or part 

eg 

ry thereof may be implemented in hardware, firmware or software, or 

m 

15 C5 some combination of at least two of the same. It should be noted 

E J I 
that the functionality associated with any particular controller, 

processor or circuitry may be centralized or distributed, whether 

\ 

locally or remotely. Definitions for certain words and phrases are 
provided throughout this patent document, those of ordinary skill 
20 in the art should understand that in many, if not most instances, 
such definitions apply to prior, as well as future uses of such 
defined words and phrases. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

For a more complete understanding of the present invention, 
reference is now made to the following descriptions taken in 
conjunction with the accompanying drawings, in which: 

FIGURE 1 illustrates a simplified block diagram of an 
exemplary media processing system, that includes an integrated 
image processing system according to one embodiment of the present 
invention; 

FIGURE 2 illustrates a block diagram of an exemplary 
processor, that includes image processing circuitry according to 
one embodiment of the present invention; 

FIGURE 3 illustrates a block diagram of an exemplary image 
processing system, that is associated both a two-dimensional image 
processing pipeline and a three-dimensional image processing 
pipeline according to one embodiment of the present invention; 

FIGURE 4 illustrates a block diagram of an exemplary 
implementation of a rasterizer, that performs motion compensation 
operations associated with two-dimensional image processing in one 
mode and rasterization operations associated three-dimensional 
image processing in another mode, all according to the principles 
of the present invention; and 
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FIGURE 5 illustrates a flow diagram of an exemplary method of 
operating an image processing system, particularly the exemplary 
rasterizer of FIGURE 4, in accordance with the principles of the 
present invention. 
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DETAILED DESCRIPTION OF THE INVENTION 

Turning initially to FIGURE 1, illustrated is a simplified 
block diagram of an exemplary media processing system (generally 
5 designated 100), that includes a central processing unit ("CPU") 
105, a memory subsystem 110, and integrated image processing system 
115, all of which are associated by a high speed bus or system bus 
120. 

"^3 Exemplary CPU 105 may be any suitably arranged type of 

Cii 

10^'^ computer processor or multi-processor. Exemplary memory 110 may be 
H any suitably arranged type of memory subsystem, including random 
access memory, mass storage device, etc. Exemplary bus 120 may be 
any suitably arranged type of communication or host bus for 
communication between CPU 105, memory 110, and exemplary image 

in 

15 U processing system 115, as well as specialized subsystems. Other 
elements of media processing system 100 that are not necessary for 
an understanding of the present invention are not shown for 
convenience . 

Image processing system 115, according to one embodiment of 
20 the present invention, is associated with bus 120 by, for instance, 
bus connectivity logic and with a video or media display system 12 5 
(i.e., systems or devices used to present text, graphics, video. 


ca 
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animation, or sound in an integrated way) . It is assumed that 
various other peripheral devices, or other buses, may be connected 
to bus 120 or media display system 125, as is well known in the 
art. Media processing system 100 may therefore be any suitably 
5 arranged type of video display system, including, without 
limitation, a computer system, a television, a personal data 
assistant, a handheld video device, game console, set -top box, or 
any other type of device or system having the ability to display a 
%j video signal . 

lOr.Z Image processing system 115 is operable to perform both two- 

and three-dimensional image processing. Broadly, image processing 

H 

iJ system 115 includes circuitry for (i) a two-dimensional image 
C3 pipeline 130, which is operable to process two-dimensional image 

E. Li 

rU data to generate successive two-dimensional image frames, and (ii) 

in 

15 £3 a three-dimensional image pipeline 135, which is operable to 
process three-dimensional image data to render successive three- 
dimensional image frames. Both the two- and three- 
dimensional image frames are for display in a two-dimensional image 
space, such as that of exemplary media display system 125. 

20 Image processing system 115 also includes dual -mode sub- 

processing circuitry 14 0 that is at least operable to perform (i) 
motion compensation operations associated with two-dimensional 
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image pipeline 130 in one mode, and (ii) rasterization operations 
associated three-dimensional image pipeline 135 in another mode. 
Exemplary dual -mode sub-processing circuitry 14 0 advantageously 
employs the inherent symmetries of the functional units performing 
5 the motion compensation operations in two-dimensional pipeline 130 
on the one hand and the rasterization operations in three- 
dimensional pipeline 135 on the other hand. 

CPU 105 and image processing system 115 preferably communicate 

a 

n data according to a programmed input/output ("I/O") protocol over 

in 

I0:,z bus 120. For instance, if a three-dimensional graphics application 
H is executing on CPU 105, then data arrays containing three- 

-a 

iJ dimensional information that define an image for display on the 

s 

C3 display device 125 may be generated by CPU 105 and transferred to 
fu memory 110. The data arrays may include three-dimensional geometry 

m 

15 C3 information in a stream of input data packets containing vertex 
coordinates (or vertices) , vertex position, and other information 
that define triangles, vectors and points in a three dimensional 
space (commonly referred to as model space) . Each input data 
packet may contain any combination of three-dimensional vertex 

20 information, including vertex position, vertex normal, vertex 
color, facet normal, facet color, texture map coordinates, pick- 
id's, headers and other information. 
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CPU 105 may operate to transfer the data to image processing 
system 115 over bus 120. In an alternate embodiment, image 
processing system 115 may read in the data arrays using direct 
memory access ("DMA") access cycles over bus 120. In yet another 
embodiment, image processing system 115 is associated with memory 
110 through a direct port, such as an Advanced Graphics Port 
("AGP") promulgated by Intel Corporation. 

Likewise, if a two-dimensional image generating application, 
such as an MEPG-based digital video application, is executing on 
CPU 105, then data containing two-dimensional information may 
similarly be generated. 

Turning next to FIGURE 2, illustrated is a block diagram of an 
exemplary integrated processor (generally designated 200), that 
includes a CPU 105, an AGP compliant memory subsystem 110, image 
processing system 115, and a PCI bridge 205, all according to one 
advantageous embodiment of the present invention. 

Exemplary CPU 105 includes a cache unit 210, an integer unit 
215, a FPU/MMX unit 220 (operable to perform floating-point 
calculations, including graphics applications) and a MMU 225 
(operable to manage memory subsystem 110) . Exemplary memory 
subsystem 110 includes a bus controller 230, a write post queue 
235, a look-aside buffer 240, and a memory control unit 245. 
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Exemplary image processing system 115 includes a host interface 
250, image processing circuitry 255, and a display controller 260. 
The functionality of elements of processor 2 00 that are known and 
not necessary for an understanding of the present invention are not 
5 discussed in further detail for convenience. 

Exemplary image processing circuitry 255 includes both two- 
and three-dimensional image pipelines, and dual-mode sub-processing 
circuitry (exemplary embodiments of the same are discussed in 
u detail with reference to FIGURES 3 and 4) . The dual -mode sub- 

cn 

10=:^ processing circuitry is at least operable to perform motion 

IQ 

compensation operations associated with the two-dimensional image 

' '-i 

iy pipeline in one mode, and rasterization operations associated with 

P the three-dimensional image pipeline in another mode. 

Co 

Turning next to FIGURE 3, illustrated is a block diagram of an 
15 U exemplary image processing system 115, shown in cooperation with 
memory subsystem 110, that is associated with both a two- 
dimensional image processing pipeline and a three-dimensional image 
processing pipeline, all according to one advantageous embodiment 
of the present invention. Exemplary image processing system 115 
20 again includes a host interface 250, image processing circuitry 
255, and a display controller 260. For purposes of illustration, 
concurrent reference is made to FIGURE 1. 
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According to an advantageous embodiment, the three-dimensional 
image pipeline associated with image processing circuitry 255 is 
operable to compute three-dimensional graphical transformations. 
In three-dimensional graphics, it is known that the digital 
representation of the surface of a given object includes, in 
addition to traditional two-dimensional qualities like color and 
brightness, texture qualities, such as transparency, reflectivity 
and the like. Well-defined textures are important to render 
realistic three-dimensional images and require significant memory 
and processing resources. 

An important aspect of this embodiment is that memory 
subsystem 110 is AGP compliant, which allows textures to be stored 
in main memory, here SDRAM, which increases the rate of transfer of 
image data between CPU 105, image processing system 115 and the 
memory . 

The three-dimensional pipeline includes three primary stages, 
namely, (i) transform and lighting, (ii) triangle setup, and (iii) 
rasterization, the general functionality of each is known. The 
transform and lighting stage, which operates to processes model 
coordinates from an executing graphics application to generate 
screen coordinates, is floating point calculation intensive and may 
advantageously be performed by CPU 105 to optimize processing 
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resource utilization. The remaining stages may advantageously be 
performed by image processing system 115. 

Also according to the present embodiment, the two-dimensional 
image pipeline associated with image processing circuitry 255 is 
5 operable to compute two-dimensional image operations and 
transformations, including standard video formats. For purposes of 
example, the two-dimensional image pipeline supports the MPEG 
family of digital video compression standards and file formats 
ij (MPEG achieves high compression rates by storing changes from one 

m 

10 image frame to another and encoding such data using DCT) . There 

H are three MPEG standards, namely, MPEG-1, MPEG-2, and MPEG-4 (based 

iJ on the QuickTime™ file format) . Common MPEG-1 implementations 

C3 provide video resolution of 352x240 at 30 frames per second (fps) , 

fy which produces video quality slightly below the quality of 

in 

15 C3 conventional VCR videos. Common MPEG-2 implementations provide 
video resolutions 720x480 and 1280x720 at 60 fps, with full CD- 
quality audio, which produces video quality sufficient for major TV 
standards, including NTSC, HDTV, DVD, and the like. 

Exemplary image processing circuitry 2 55 illustratively 

20 includes a three-dimensional rasterizer 300, a setup controller 
305, a VGA 310 and an arbiter 315. Exemplary three-dimensional 
rasterizer 300, according to the present embodiment, is operable to 
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perform common three-dimensional rasterization operations including 
processing triangles, vectors, planar trapezoids, alpha blending, 
and the like, as well as to perform texture mapping operations when 
image processing system 115 is in three-dimensional mode, and to 
5 perform two-dimensional motion compensation operations associated 
with the two-dimensional image pipeline when image processing 
system 115 is in two-dimensional mode. 

Exemplary setup controller 305 is operable to parse a command 

a 

%j buffer and to sequence the motion compensation operations for a 

10 frame, wherein the command buffer is built by CPU 105 which 

Co 

M performs two-dimensional processing operations, such as inverse 

''J 

iJ quantization, inverse DCT, and the like. Exemplary VGA 310, or 

C3 video graphics array, is a graphics display system that in text 

ru mode provides a resolution of 72 0x4 00 pixels and in graphics mode 

in 

15 C3 provides a resolution of 640x480 (with 16 colors) or 320x200 (with 

C3 

256 colors) . Exemplary arbiter 315 is operable to moderate or 
control communication among three-dimensional rasterizer 300, a 
setup controller 305, and a VGA 310 on the one hand and memory 
subsystem 110 on the other hand. 
20 Turning next to FIGURE 4, illustrated is a block diagram of an 

exemplary implementation of three-dimensional rasterizer 3 00, that 
includes dual -mode image processing circuitry operable to perform 
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motion compensation operations associated with two-dimensional 
image processing in one mode and traditional rasterization 
operations associated with three-dimensional image processing in 
another mode according to the principles of the present invention. 
Exemplary three-dimensional rasterizer 300 is operable, in 
three-dimensional (default) mode, to process triangles, vectors, 
planar trapezoids, alpha blending, and the like, and to perform 
texture mapping operations. Texture mapping operations define 
object textures and "wrap" the same around respective objects in 
three-dimensional space. Pixels in three-dimensional space, in 
addition to the properties of position, color, and brightness, have 
a depth property that indicates where a point lies on an imaginary 
Z-axis. As rasterizer 300 combines three-dimensional pixels, each 
having its own depth value, the result is a "three-dimensional 
surface." Rasterizer 300 supports multiple objects interacting 
with one another, such that for instance, one object may partially 
hide another object behind it. Rasterizer 300 is operable to 
perform hidden surfaces removal by comparing the depth (z) value of 
a pixel being drawn to the depth value of an existing pixel at that 
location. If the pixel being drawn is closer to the viewer than 
the existing pixel, then the new pixel is written to the frame 
buffer, otherwise the new pixel is discarded (because it is behind 
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what has already been drawn) . In addition to the foregoing, and as 
discussed in detail below, Rasterizer 300 is also operable in two- 
dimensional mode to perform two-dimensional motion compensation 
operations associated with the two-dimensional image pipeline. 
5 Three-dimensional rasterizer 300 is operable, in two- 

dimensional mode, to process two-dimensional image data and to 
perform motion compensation operations. Motion compensation 
operations apply motion vector data to one or more current or prior 
%j image frames to generate a new or next image frame of video data. 

rri 

10 There are several known types of motion vectors, and a single 

£3 

1^ encoded MPEG frame can contain an arbitrary combination of motion 

iy vector types depending on the image content. Advantageously, each 

C3 set of motion vectors is used to produce a single macroblock of 

!U data. A macroblock is the basic unit on which MPEG compression 

in 

15 C3 algorithms are applied, which, according to the exemplary 

u 

embodiment hereof may be 8x4 (typically, interlaced frames) or 8x8 
pixels. Motion compensation operations may suitably be summarized 
as: (i) sampling "n" reference frames, where n is 0, 1, or 2 (the 
sample region is a macroblock in size but can be aligned to a half- 
20 pixel boundary in both x and y; if the macroblock is on a half- 
pixel boundary, bilinear filtering must be used) ; (ii) if two 
reference frames are sampled, average the samples from the two 
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frames to yield a new macroblock; (iii) if a set of error terms is 
specified for the macroblock, add the error terms to the results of 
(ii) (the error terms are normally specified as 9-bit signed 
values, though some decoders use 8 -bit signed values) ; and (iv) 
repeat the operation for every macroblock in the new frame being 
created. 

Rasterizer 300 includes edge walk circuitry 400, a Z buffer 
405, a pixel blender 410, texture mapping circuitry 415 and a two- 
dimensional pipeline 420. Exemplary edge walk circuitry 400 is 
operable to compute the starting and ending x coordinates of each 
scan line of a trapezoid being drawn, noting that triangles and 
rectangles are special types of trapazoids. Exemplary Z buffer 405 
is a memory system operable to store Z-axis values of pixels in 
three-dimensional graphics applications, and includes a Z 
interpolator 425, Z compare circuitry 430, and format /writeback 
circuitry 435. Exemplary pixel blender 410 is operable to combine 
pixels, in both two- and three-dimensional space, in a manner 
suitable to account for interaction among associated pixels in two- 
dimensional image space. Pixel blender 410 includes A/R/G/B 
interpolator 440, lighting/mixture blend circuitry 445, alpha test 
circuitry 450, alpha blend circuitry 455, and format/dither 
circuitry 460. Exemplary texture mapping circuitry 415 is operable 
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to define and to map digital representations of surfaces, or 
textures, for objects in three-dimensional image space, and to 
perform motion compensation operations in two-dimensional image 
space. Texture mapping circuitry 415 includes U/V/Q interpolator 
4 65, perspective correct circuitry 470, address generation 
circuitry 475, texture cache circuitry 480, and format/filter 
circuitry 485. Exemplary two-dimensional pipeline 42 0 is operable 
to process two-dimensional image data to perform conventional 
functions, such as rectangle fills, block moves, text, line 
drawing, etc. Two-dimensional pipeline 420 includes "8x8" pattern 
circuitry 490, mono expansion circuitry 495 and raster operation 
circuitry 499. 

The conventional functionality of each of the elements of Z 
buffer 405, pixel blender 410, texture mapping circuitry 415 and 
two-dimensional pipeline 42 0 are generally known and specific 
discussion of such functionality is not necessary for an 
understanding of the present invention and are not discussed in 
further detail for convenience. 

For purposes of describing the present embodiment, it is 
advantageous to discuss those functional elements of rasterizer 300 
comprising dual mode sub-processing circuitry (illustratively shown 
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as block 140 in FIGURE 1) , which collectively are associated with 
each of the two-dimensional and three-dimensional image pipelines. 

Exemplary dual -mode sub-processing circuitry includes 
light ing/mixture blend circuitry 445, alpha blend circuitry 455, 
5 format/dither circuitry 460, U/V/Q interpolator 465, address 
generation circuitry 475, texture cache circuitry 480, 
format/filter circuitry 485, "8x8" pattern circuitry 490, mono 
expansion circuitry 495, and raster operation circuitry 499. 

\1 Collectively, the foregoing circuitry is operable according to the 

Cn 

10 «S principles hereof to perform rasterization operations associated 

[3 

said three-dimensional image pipeline in a default mode and to 

LJ perform motion compensation operations associated with the two- 

Q dimensional image pipeline in the other mode. 

rU Exemplary lighting/mixture blend circuitry 445 is operable to 

in 

15 tl combine pixels, in both two- and three-dimensional space, in a 
manner suitable to account for interaction among associated pixels 
in an image space based upon lighting. Particularly, in three- 
dimensional image processing mode, lighting/mixture blend 
circuitry 445 operates to combine multiple textures and the color 

20 from ARGB interpolator 440 using a variety of multiply/add 
operations, and in two-dimensional image processing mode it 
operates to combine multiple reference frames by averaging. 
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Exemplary alpha blend circuitry 455 is operable to combine 
pixels, in both two- and three-dimensional space, in a manner 
suitable to account for interaction among associated pixels in 
image space based upon depth. Particularly, in three-dimensional 
5 image processing mode, alpha blend circuitry 455 operates to 
combine a new pixel value an existing pixel value in memory to 
preclude transparency effects, and in two-dimensional image 
processing mode it operates to add error terms to the combined 

%J reference frames. 

in 

10 =S Exemplary format/dither circuitry 460 is operable to convert 

pixel data from the format used with in rasterizer 300 to the 
iJ format stored in memory. Particularly, in three-dimensional image 

C3 processing mode, format/dither circuitry 460 operates to convert 

CO 

32-bit pixels (888 ARGB, i.e., 8 bits each of A, R, G, and B)to a 

in 

15^; variety of formats (e.g., 565 RGB, 4444 ARGB), and in two- 
dimensional image processing mode it operates to pack four 
consecutive pixels of a macroblock into a 32 -bit quantity to write 
to memory. 

Exemplary U/V/Q interpolator 465 is operable to generate U, V 
20 and Q values of pixels in three-dimensional graphics applications 
based upon other known values. Particularly, in three-dimensional 
image processing mode, U/V/Q interpolator 465 operates to compute 
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U, V, and Q at each pixel given initial values at one vertex and 
slopes along the scan line and edge. U, V, and Q specify which 
pixel with a texture map is applied to the current pixel, and in 
two-dimensional image processing mode it operates to compute the 
5 starting location of the next group of four pixels within a 
reference frame. 

Exemplary address generation circuitry 475 converts U, V, and 
Q values to memory addresses for fetching texture data. 

C3 

Q Particularly, in three-dimensional image processing mode, address 

[11 

10 =S generation circuitry 475 operates to use (U/Q, V/Q) as a two- 

cg 

K dimensional index into a texture map, and in two-dimensional image 
Ly processing mode it operates to use U asa linear (byte) offset into 


S- 


a reference frame and V as the byte offset between successive scan 


iD lines in a reference frame. 

m 

15 C3 Exemplary texture cache circuitry 480 is operable to provide 

C3 


fast access to frequently used texture or reference frame data. 
Particularly, in three-dimensional image processing mode, texture 
cache circuitry 480 operates to provide up to four pixels (u,v) , 
(u+l,v) , {u,v+l) , (u+l,v+l), -- for bilinear filtering, and in 
20 two-dimensional image processing mode it operates to provide up to 
four sets of four pixels from the reference frame -- [u:u+3] , 
[u+l:u+4] , [u+v:u+v+3] , [u+v+1 :u+v+4] . 
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Exemplary format /filter circuitry 485 is operable to convert 
from pixel format in memory to four 8 -bit components and perform 
bilinear filtering on each component. Recall that texture cache 
480 provides up to four pixels or sets of pixels corresponding to 
the four corners of a bilinear filter cell. Particularly, in 
three-dimensional image processing mode, format/filter circuitry 
485 operates to convert to 8888 ARGB and performs bilinear 
filtering based on subtextel positioning (i.e., fractional bits of 
U/Q and V/Q) , and in two-dimensional image processing mode it 
operates to perform bilinear filtering on four pixels based on 
half-pixel offsets in x and y. 

Exemplary "8x8" pattern circuitry 490 is operable to provide 
a repeating pattern of 8x8 pixels in size -- typically used in 
rectangle fills. The output of pattern circuitry 490 is used as 
the pattern operand for raster operation circuitry 499. Exemplary 
mono expansion circuitry 495 is operable to convert one bit per 
pixel to a foreground and background color. This circuitry is used 
with 1-bit-per-pixel patterns or text glyph (font) data. Exemplary 
raster operation circuitry 499 is operable to combine pattern, 
source, and destination data in an arbitrary fashion. Pattern 
comes from the 8x8 pattern circuitry. Source can come from a 
location in the frame buffer (e.g., rectangle copy operation) or 
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the host CPU, Destination is the current value in the frame buffer 
at the location that will be written with the result of the raster 
operation. 

Turning now to FIGURE 5, illustrated is a flow diagram 
(generally designated 500) of an exemplary method of operating an 
image processing system 115, particularly the exemplary rasterizer 
3 00 of FIGURES 3 and 4, all in accordance with the principles of 
the present invention. For purposes of illustration, concurrent 
reference is made to FIGURES 1 to 4 which introduced image 
processing circuitry 115 that comprised two-dimensional image 
pipeline 130, three-dimensional image pipeline 135, and dual-mode 
sub-processing circuitry 140. 

Two-dimensional image pipeline 130 is operable to process two 
dimensional image data to generate successive two-dimensional image 
frames for display in a two-dimensional image space, whereas three- 
dimensional image pipeline 135 is operable to process three- 
dimensional image data to render successive three-dimensional image 
frames for display in a two-dimensional image space. Dual -mode 
sub-processing circuitry 140 is associated with both pipelines. 

To begin, a determination is made as to whether image 
processing circuitry 115 is to process image data in two- or three- 
dimension mode (decision step 505) . If image processing circuitry 
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115 is in two-dimensional mode C'N" branch of decision step 505), 
dual -mode sub-processing circuitry 140 performs motion compensation 
operations associated with two-dimensional image pipeline 130 
(process step 510) . If image processing circuitry 115 is in three- 
5 dimensional mode ("Y" branch of decision step 505) , dual -mode sub- 
processing circuitry 140 performs rasterization operations 
associated three-dimensional image pipeline 135 (process step 515) . 
In two-dimensional mode, dual -mode sub-processing circuitry 

3 t 

140 performs motion compensation operations by sampling reference 

m 

10 frames (process step 520), then blending samples from a plurality 

eg 

M of reference frames (process step 525) , and then processing the 
LlJ plurality of reference frames using error terms (process step 530) . 

s 

C3 In three-dimensional mode, dual -mode sub-processing circuitry 140 

ILI 

fy performs texture mapping (process step 535) , blending samples from 
15 £3 a plurality of texture maps (process step 540), and performing 

a XL 
i : 

alpha blending (process step 545) , wherein, according to the 
present embodiment, performs alpha blending, in part, by processing 
at least 8- and 9-bit signed values. 

Although the present invention has been described in detail, 
20 those skilled in the art should understand that they can make 
various changes, substitutions and alterations herein without 


29 


DOCKET NO. P04211 


PATENT 


departing from the spirit and scope of the invention in its 
broadest form. 
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